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sJ ■ Abstract 

Employing a suitable nonlinear Lagrange functional, we derive gen- 
eralized Hamilton-Jacobi equations for dynamical systems subject to 
linear velocity constraints. As long as a solution of the generalized 
Hamilton-Jacobi equation exists, the action is actually minimized (not 
just extremized). 
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1 Introduction 

Consider a mechanical system with configuration space R". Let L be the 
Lagrangian, and suppose that the system is subject to k < n nonholonomic 
constraints of the form 

ujiixit)fx{t) = 0, ? = 1,2,...,A:, tG[to,ti], (1.1) 

where the Wj : M" — * R" are smooth functions and T denotes transpose. Let 
Q{x) be the k x n matrix whose «*'* row is uJi{x)'^. Then, an application of 
d'Alembert's principle, together with the method of Lagrange undetermined 
multipliers, gives that the equations of motion for the system are 

dt dx dx 
where A is the k dimensional Lagrange multiplier. Equation (1.2) together 
with (1.1) constitute a system oi n + k equations for the n + k unknowns 
xi,X2, . . . , Xn, Ai, A2, . . . , Afc. The components of Q^X can be physically in- 
terpreted as the components of the (polygenic) force which acts on the me- 
chanical system in order to maintain the given non-holonomic conditions [7]. 
Notice that d'Alembert's principle is not variational. A variational approach 
to dynamics of systems subject to linear velocity constraints was proposed 
in [12] (see also [1, Chap. 1, Sect. 4]). A lucid critique of this "Vakonomic 
dynamics" (variational axiomatic kind dynamics) can be found in [17]. It 



is shown there that the vakonomic equations may lead to paradoxical be- 
haviour. The relation between the vakonomic and holonomic approaches has 
also been discussed in [1, 8, 14, 3, 5, 4]. 

We show in this paper that the second, hydrodynamic form of Hamilton's 
principle may be extended to nonholonomic systems. As long as a solution 
of the generalized Hamilton- Jacobi equation exists, the action is minimized 
by a path satisfying the correct equations of motions (1.2). Our derivation 
relies on general nonlinear Lagrange functionals [10, 11]. 

2 The classical Hamilton principle 

We review below the hydrodynamic form of the classical Hamilton principle 
in the strong form established in [16, Section II] that developed from [6]. 
Consider a dynamical system with configuration space R". Let 

L{x, v) := -mv ■ v — V{x) (2.3) 

be the Lagrangian function, where V{-) : M" ^ M is of class C^. Extension 
of the results of this paper to general Lagrangian functions that are strictly 
convex with respect to v appears straightforward. We prefer, however, to 
treat the simple case (2.3) in order to avoid obscuring ideas with technical- 
ities. Let Xq denote the class of all C^ paths x : [to,ti] -^ R" such that 
x{to) = xq. Let V denote the family of continuous functions v : [to,ti] -^ R". 
For {x,v) G {Xq X V), we define the functional J{x,v) by 



J{x,v)= [' L{x{t),v{t))dt - Si{x{ti)), (2.4) 

Jto 



where 5"! : K" ^ K is continuous. Consider the following control problem: 

Minimize {J{x,v)\{x,v) e {Xq x V)}, (2.5) 

subject to the constraint 

x{t) = v{t), yte[to,h]. (2.6) 

Remark 2.1 It is apparent that this control problem is equivalent to mini- 
mizing the action functional I{x) := J{x, x) over Xq. 

To solve problem (2.5)-(2.6) we rely on the following elementary, albeit fun- 
damental, result in the spirit of Lagrange. Consider the minimization of 
J : Y ^ R, where M denotes the extended reals, over the nonempty subset 
Mof F. 

Lemma 2.2 (Lagrange Lemma) Let A : Y ^ R and let yo E M minimize 
J + A over Y. Assume that A(-) is finite and constant over M. Then yo 
minimizes J over M. 

Proof. For any y G M, we have J(?/o) + A(l/o) < J{y) + A{y) = J{y)+A{yo). 
Hence J{yo) < J{y). □ 

A functional A which is constant and finite on M is called Lagrange func- 
tional. For problem (2.5), let 

M = {{x,v) e Xqx v\x{t) = v{t),yte [to,ti]}. 

We introduce a suitable class of nonlinear Lagrange functionals for our prob- 
lem. Let F : [to,ti] x K" ^ R be of class C^. Corresponding to such an F, 



we define the nonlinear functional A^ on A*! x V 



A^{x,v) := F(ti,a;(ti))-F(to,a;(to)) + 



to 



OF 

- — {t,x{t)) - v{t) ■VF{t,xit)) 



dt. 



When {x,u) G M, by the chain rule, we have A^{x,u) = 0. Thus, A^ is 
indeed a Lagrange functional for our problem. The solution procedure is 
now outlined as follows. 
Step 1. Consider the unconstrained minimization 



min (J + A^)(x, v). 



(2.7) 



We perform two-stage optimization. Namely, for each fixed x G Aq , we 
try to compute an optimal control v* through pointwise minimization of the 
integrand of J + A-^. More explicitly, consider for each x G Aq and each 
t G [to)^i] the finite-dimensional problem 



mill < —mv ■ V — V{x(t)) 
dgM I Z 



dF 
'dt 



{t,x{t)) -vVF{t,x{t)) 



We get 



<(t) = -VF(t,x(t)). 



m 



(2i 



(2.9) 



We notice that v* belongs to the class of admissible velocities V. 
Step 2. Consider now the minimization of the functional 



T^{x) = {J + A^){x,v:) 



on the space Xq. We have 



TUx) 



-Si{x{ti)) + F{ti, x(ti)) - F(to, x{to)) + 



to 



dF 
'~dt 



(t,x(t)) 



2m 



VF{t, x{t)) ■ VF(t, x{t)) - V{x{t)) 



dt. 



If we can find S such that r'^(-) is actually constant on Xq, then any pair 
(x, V*) G {Xi X V) solves problem (2.7). Then, by Lemma (2.2), if the pair 
(x, f *) satisfies 

a;(^) = Kii) = -VS{t,x{t)), Vt G [to,ti], 
m 

it also solves the original constrained problem (2.5)-(2.6). 

Theorem 2.3 ([16]) Let S{t,x) be any C^ solution on [to,ti] x M" of the 
terminal value problem 

_ + _VS.VS + V'(x)=0. (2^10) 

S{ti,x) = Si{x). (2.11) 

Then any x E Xq satisfying on [to,ti] 

x(t) = —\/S(x(t),t), (2.12) 

m 

solves together with —'VS{x{t),t) problem (2.5)-(2.6). 

Proof. If S solves (2.10)-(2.11), we get T^{x) = S{xo,to) on Xq. D 

Notice that when a C^ solution S{x,t) of (2.10)-(2.11) exists, then there are 
also solutions x of the differential equation (2.12) satisfying a;(to) = xq, and 
therefore optimal pairs. In this case, the action functional is actually mini- 
mized, not just extremized. The difficulty lies, of course, with the terminal 
value problem (2.10)-(2.11) that, in general, only has a local in t solution 
(namely, on some interval {i,ti\, to <i). 



Remark 2.4 Let us now assume that S is of class C^. Following [6], let us 
introduce the acceleration field a{t, x) through a substantial time derivative 



a{t, x) :- 



d 




1 




' 




+ 




VS 


V 


di 




m 







[^VS){t,x) = -V 
m m 



dt 2m 



(t,x). 



Then, (2.10) implies the local form of Newton's law 

a(t,x) = W(x). 

m 



(2.13) 



3 Nonholonomic dynamical systems 



Consider a system subject to linear velocity constraints of the form 



f](x(t))i:(t) = 0, te[to,h], 



(3.14) 



where fi : M" ^ m'^^", /c < n is a continuous map. We assume that for eack 
a; G K", the rows of Q are linearly independent. These constraints are called 
Pfaffian. A simple example is provided by a disk rolling on a plane without 
slipping. More complex nonholonomic systems with Pfaffian constraints oc- 
cur in many problems of robot motion planning and have therefore been the 
subject of intensive study, see [15, 13, 2] and references therein. Let 



n{x{t))v{t) =0, te[to,ti]. 



(3.15) 



We now study the control problem (2.5)-(2.6)-(3.15), namely the same prob- 
lem as in the previous section when also constraint (3.15) is present. This 
problem is equivalent to minimizing the action functional 

Hi 



I{x) := J{x, x) 



to 



L{x{t),x{t))dt - Si{x{ti)), 



(3.16) 



under the constraints (3.14). Reformulating the calculus of variations prob- 
lem as a control problem as before, we let 

M = {{x, t;) e A'o X V I x{t) = v{t),n{x{t))v{t) = 0, Vt G [to, h]}. 

Let F : [tQ,ti] x W ^ R be of class C^ and g : [to,ti] x M" -^ m'' be 
continuous. Corresponding to such a pair, we define the nonlinear functional 
A^'9 on Afo X V by 



A^'\x, v) := F{t,, x{h)) - F(to, x{to)) + 



ti 



to 



dF 

- — (t, x{t)) - v{t) ■ VF{t, x{t)) + g{t, xit)fQ{x{t))v{t) 



dt. 



It is apparent that A-^'^ is a Lagrange functional for the problem since it is 
identically zero when (2.6) and (3.15) are satisfied. Following the same pro- 
cedure as in the previous section, we consider the nnccinstramefi minimization 
of K^'^{x,v) over [Xq x V). For x E Xq fixed, the pointwise minimization of 
the integrand of J + A^'^ at time t gives 

1 



v:{t) 



m 



\/Fit,xit))-n'ixit))git,xit)) 



(3.17) 



Notice that v* G V. We consider next the minimization of the functional 



r^'S{x) = {J + A^'^){x,v:) 



on the space Xq. We have 



+ 



to 



T^'3^x) = -Si{x{h)) + F{x{h),h) - F{x{to),to) 

BF 1 

- — (t,xit)) - —\\VFit,xit)) - n^ixit))git,xm\' -Vixit)) dU 



where 1 1 ■ 1 1 denotes the Euchdean norm in M". Let S{t, x) of class C^ and 
IJ,{t,x) continuous solve on M" x [to,ti] of the initial value problem 

dS 1 
dt 2m 
S{x,to) = So{x). 



vs-n'n\\' + v{x) = 0, 



(3.18) 
(3.19) 



Then r^'^{x) = S{xo,tQ) on Xq- By Lemma (2.2), ii x E Xq satisfies for all 
te [to,ti] 



x{t) 



m 



\/S{t, x{t)) - n'^{x{t))fi{t, x{t)) 



n{x{t))x{t) = 0, 



(3.20) 
(3.21) 



then it solves the problem together with the corresponding feedback velocity 
(3.17). 

Remark 3.1 As in the unconstrained case, we now show that (3.18) implies 
the second principle of dynamics. Assume that 5" is of class C^ and that Q, 
and fi are of class C^. The acceleration field is again obtained through a 
substantial derivative of the velocity field 



a{t,x) :- 



d 



1 



dt m 



vs - n^fi 



'm 



m 



^^ ^ ii__^ y^T ii9 



vs-n^^j\){t,x) 



dt 



{t,x). 



Then, (3.18) yields 



a{t,x) = --VV{x)--n^^. 
m m ot 



Define 



X{t, x) :- 



dfi 
"dt 



{t,x). 



(3.22) 



For X E Xq satisfying (3.20) and of class C^, let A(t) := X{t,x{t)). We then 
get 

mx{t) = -VV{x{t)) + n'^{x{t))X{t), (3.23) 

namely equation (1.2). By differentiating (3.21), a simple calculation em- 
ploying (3.23), shows that the Lagrange multipliers A may be expressed as 
an instantaneous function of x and x, see e.g. [17, Section 2], [15, pp. 269-270]. 

Next we show how the multiplier /i can be eliminated in our hydrodynamic 
context. If a; satisfies (3.20)-(3.21), then, plugging (3.20) into (3.21), we get 



Q(x(t))— \vS(t,x(t))-Q^(x(t))fi(t,x(t)) 
m L 

Since Vt has full row rank, the latter is equivalent to 







/i(t, x{t)) = {Q{x{t))Q^{x{t)))-^Q{x{t))VS{t, x{t)) (3.24) 

Plugging this into (3.20), we get 

xit) = ^ [(/ - 7r(x(t))) V5(t, x(t))] , (3.25) 

where 7r(t,x) is defined by 

7r(a;) = Q^{x){Q{x)Q^{x))-^Q{x). (3.26) 

Observe that 7r(x)^ = n{x) and 7t{x)'^ = n{x). Thus, 'k{x) is an orthogonal 
projection. In fact, n{x) is the orthogonal projection onto Range {Q'^{x)). 

Remark 3.2 Notice that (3.25) implies (3.21). Indeed, 

Q{x{t))x{t) = Q{x{t))— [(/ - 7r{x{t))) VS{t,x{t))] = 0, 

m 

since / — 7r(x) projects onto the kernel of Q{x). 

10 



Now we use the freedom we have in picking S and yU. Since (3.24) must 
be satisfied by an optimal solution, we impose that the pair {S, /x) satisfies 
identically on all of [to,ti] x R" 

fi{t,x) = {n{x)Q^{x))-^n{x)VS{t,x). (3.27) 

Hence, T^'^^{x) = T^{x) and equation (3.18) becomes 

|^ + ^ll(/-^)V5|P + n:^) = (3.28) 

We are now ready for our main result. 

Theorem 3.3 For x G R", let a{x) = I — nix) denote the orthogonal pro- 
jection onto keri7(x). Let S{t,x) be any C-^ solution on [to,ti] x R" of 

— + \/S-a\/S + V(x) = 0, S(ti,x) = Si(x). (3.29) 

ot 2m 

Then any x E Xq satisfying 

x(t) = —a(x(t))\/S(t,x(t)) (3.30) 

m 

on [to,ti] solves together with 

v{t) = —a{x{t))VS{t,x{t)) 
m 

problem (2.5)-(2.6)-(3.15) (equivalently, such an x E Xq minimizes (3.16) 

subject to (3.14))- US is of class C"^ , and x G Xq satisfying (3.30) is also of 

class C^, then x satisfies equation (3.23) 

mx{t) = -VV{x{t))+n^{x{t))X{t), 

with X given by 

X{t) = -(fi(x(t))fi^(x(t)))-ifi(x(t))v|^(t, x(t)). (3.31) 

11 



Proof. If S solves (3.29), we get r^'^(a;) = T^{x) = S{xo,to) for any x e 
Xq. Thus any pair {x, v) G {Xq x V) solves the unconstrained minimization 
problem. Since x satisfies (3.30), constraint (2.6) is fulfilled. Moreover, by 
Remark 3.2, (3.15) is also satisfied. By Lemma 2.2, the pair is optimal for 
the original constrained minimization. Finally, x satisfies (3.23) with A as in 
(3.31) in view of Remark 3.1 and (3.27). □ 
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